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Problem:  Nano  EHS  Data  for  Risk  Assessment  is 

Insufficient  Because  of  Fast  Emergence  of 


Increasing  gap  requires  innovative  risk  management 


from  Linkov  and  Satterstrom,  2008  -j-j- 


Number  of  Publications 


Hypothesis  and  Main  Point 


■  Relation  of  pattern,  structure-activity  and  physico-chemical 
properties  of  nanoparticles  on  toxicity  and  life-cycle  risk  is 
widely  unknown  and  available  information  is  fragmented. 


■  Challenges  of  risk  assessment  and  management  for  situations 
with  a  limited  knowledge  base  and  high  uncertainty  and 
variability  require  coupling  traditional  risk  assessment  with 
multi-criteria  decision  analysis  (MCDA)  and  Life  Cycle 
Assessment  (LCA)  to  support  sustainable  nanomanufacturing 
and  regulatory  decision  making. 

■  Entities  engaged  in  nanotech  must  consider  practical  and 
innovative  steps  to  develop  sustainable  nanomaterials 
minimizing  identified  life-cycle  product  risk  while  keeping 
costs  down. 


Overview 


■  Intro  to  Multi-Criteria  Decision  Analysis 

■  Nano  and  Traditional  Risk  Assessment 

■  Integration  of  RA/MCDA/LCA  for  Nano:  Carbon  Nanotubes 
Manufacturing  Case  Study 

-  Problem 

-  LCA  assessment 

-  Integrated  RA/MCDA 

-  Incorporation  of  Stakeholder  Preferences 

-  Value  of  Perfect  Information  Analysis 

-  Value  of  Imperfect  Information  Analysis 

■  Conclusions 
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Current  RA/Decision-Making  Processes 


Challenge:  Multiple  &  Uncertain  Criteria 
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Problem:  Parameter  Uncertainty 


Oil  and  Grease  in  Sediment 


Parameter  Uncertainty 

Uncertainty  and  variability  in 
model  parameters  resulting  from 

-  data  availability 

-  expert  judgment 

-  empirical  distributions 


S  55 


5  53 


VAR1 


I  Mean+SD 
Mean-SD 
I  I  Mean+SE 
Mean-SE 
□  Mean 


■  Can  be  addressed  by 

-  Probabilistic  Simulations  (Monte-Carlo) 

-  Analytical  techniques  (uncertainty  propagation) 

-  Expert  estimates 

Many  parameters  and  factors  important  for  risk  assessment  are 


not  well  known,  reported  ranges  are  large  and  often 

unquantifiable 


Problem:  Model  Uncertainty 


■  Model  Uncertainty 

-  Differences  in  model  structure  resulting  from 

♦  model  objectives 

♦  computational  capabilities 

♦  data  availability 

♦  knowledge  and  technical  expertise  of  the 
group 

-  Can  be  addressed  by 

♦  considering  alternative  model  structures 

♦  weighting  and  combining  models 

♦  Eliciting  expert  judgment 


Linear  Model 


y  =  3x  -  0.6667 


Polynomial  Model  9 

y  =  2x  -  5x  +  6 


X 


Mechanistic  models  for  environmental  risk  assessment  are  very 
uncertain  and  expert  judgment  is  required 


Problem:  “Modeler/Scenario  Uncertainty ” 

subjective  interpretation 
of  the  problem  at  hand 


WHAT  DO  YOU  SEE  ? 


A  HAT 

OR 

A  BOA  CONSTRICTOR 
DIGESTING  AN  ELEPHANT 


fP 

What  is  the  relative  influence  of  * 

\jp 

#v  \ 

modeler  perception  on  model  predictions? 


/  •  * 

\  • 

j£jg 


After  Antoine  Marie  Roger  de  Saint-Exupery 


Multi-Criteria  Decision  Analysis 


■  Refers  to  a  group  of  methods  used  to  impart  structure  to  the 
decision-making  process 

■  Generally  consists  of  four  steps: 

-  Creating  a  hierarchy  of  criteria  relevant  to  the  decision  at 
hand,  for  use  in  evaluating  the  decision  alternatives 

-  Weighting  the  relative  importance  of  the  criteria 

-  Scoring  how  well  each  alternative  performs  on  each 
criteria 

-  Combining  scores  across  criteria  to  produce  an  aggregate 
score  for  each  alternative 
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Multi-Criteria  Decision  Analysis  and  Tools 


•  Multi-Criteria  Decision  Analysis  (MCDA)  methods: 

-  Evolved  as  a  response  to  the  observed  inability  of  people  to 
effectively  analyze  multiple  streams  of  dissimilar  information 

-  Many  different  MCDA  approaches  based  on  different 
theoretical  foundations  (or  combinations) 

•  MCDA  methods  provide  a  means  of  integrating  various  inputs 
with  stakeholder/technical  expert  values 

•  MCDA  methods  provide  a  means  of  communicating 
model/monitoring  outputs  for  regulation,  planning  and 
stakeholder  understanding 

•  Risk-based  MCDA  offers  an  approach  for  organizing  and 
integrating  varied  types  of  information  to  perform  rankings 
and  to  better  inform  decisions 


Tool  Integration 


Evolving  Decision-Making  Processes 
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Simplified  Decision  Matrix 


Plan 

Cost 

Eco 

Health 

Human 

Health 

A 

100 

10 

5 

B 

100 

5 

10 

C 

150 

10 

10 

D 

150 

10 

15 

ii  11 


Example  Decision  Matrix 


How  to  combine  these  criteria? 

◄ - ► 
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Risk  Assessment  Formulation 
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Traditional  Risk  Assessment 


■  Goal:  Will  exposure  to  a  contaminant  cause  adverse  health 
effects? 

■  Based  on  data  (often  limited  and  imprecise)  regarding  toxic 
effects  of  materials  on  people  and  animals 

■  State-of-the-science  risk  assessment  is  not  very  far  advanced 

-  Two  general  bodies  of  data 

♦  Toxicity  studies  in  animals 

♦  Epidemiologic  studies  in  humans 

-  Uncertainties  can  be  tremendously  large 

■  Often  handled  as  a  "bright  line"  approach,  but  typically 
plagued  with  uncertainties 
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Risk  Quantification 


Benchmarks  -  Reflection  of  “Acceptable”  Risk 


MediaConcentration 

Benchmark 


Hazard  Quotient 
( Chemical-  Specific) 


W  =  I  HQ, 

i 


Hazard  I ndex 
(Cumulative) 


No  benchmarks  for  nano! 
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Example:  Linking  RA,  MCDA  and  Life-Cycle 

Analysis  for  Nanomaterials 


■  Problem:  find  optimal  manufacturing  process  for  SWCNT 
(Single  Wall  Carbon  Nano  Tubes) 

■  Consideration  of  4  manufacturing  process  alternatives:  HiPco, 
Arc,  Laser,  CVD 

■  Combined  MCDA  (stochastic  version  of  PROMETHEE  II)  on 
energy  and  material  efficiency,  life  cycle  score,  health  risk  and 
cost 


After  Seager  and  Linkov,  2008,  and 
Canis,  Seager,  Linkov,  2010 


# 


Linking  RA,  LCA  and  MCDA 


Nanomaterials 

life-cycle 


RISK  ANALYSIS 


LIFE  CYCLE  ASSESSMENT 


CVD 


Arc 


Laser 


HiPco 

Manufacturing  Process 


MULTI  CRITERIA 
DECISION  ANALYSIS 


Based  on  Cam's,  Seager  &  Linkov  (2010) 
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Carbon  source  &  metal  catalyst 


A  SCWTffrspecific  LCA:  Manufacturing 


Purposes  of  LCA: 

•  improvement  assessment 

•  comparative  decision-making 


Li+  Electrolyte 
Celgard  seperator 
lv^LiCo02 

Copper  foil  support 


SWCNT  photos  provided  by  Brian  Landi,  Nanopower  Research 
Labs  (Ryne  Raffelle,  Director) ,  Rochester  Institute  of  Technology. 


waste 

acid 


Criteria  for  the  Comparison  of  Manufacturing 


Manufacturing: 
energy 
efficiency, 
material  yield 


Alternatives 


LCIA  score 


Heath  risks: 

persistence, 

mobility, 

bioaccumulation, 

toxicity 

(not  included  in 
this  analysis  -  lack 
of  information) 
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LCA  Components: 
Material  Yield  and  Ecoindicators 


Material  yield 


Environmental  Assessment  of 
Single- Walled  Carbon 
Nanotube  Processes 

M  eagan  L.  Healy,  Lindsay  J.  Dahlben ,  and  Jacqueline  A.  Isaacs 


Table  I  Key  yield  parameters  for  production  of 
single-walled  nanotubes  (SWNTs) 


Arc 

CVD 

HiPco 

Process  Parameter 

(%) 

(%) 

(%) 

Synthesis  reaction 

4.50 

2.95 

0.08 

yield  (SRY) 
Purification  yield 

70 

90 

90 

Note:  CVD  =  chemical  vapor  deposition;  HiPco  =  high- 
pressure  carbon  monoxide. 


reduction  Q  CVD  SWNT  Production  01  HiPco  SWNT  Production 


jposrtion  (CVD).  and  high-pressure  carbon  monoxide  (HiPco)  base  case 
=  single-walled  nanotube;  Pt  =  normalized  impact  per  gram  of  product. 


LCIA  score 
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Criteria  Distributions 


Literature  Data  represented  as  probability  distributions 
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Ranking  of  alternatives 
(equal  criteria  weights) 


70%  I 

60% 

50%  T 

I 

4  3 i 

30% 
20%  J 
10%  - 
0%  4 


Laser 


■  Laser 

■  Arc 

■  CVD 

■  HiPco 
4 


# 


Accounting  for  Stakeholder  Preferences 


■  Sets  of  weights  (or  weight  ranges)  corresponding  to  different 
stakeholders  can  be  established 

e.g.,  LCIA  score  is  likely  to  be  less  important  to  manufacturers 

■  For  each  fixed  set  of  weights,  analysis  can  be  run  again 

■  For  each  stakeholder,  we  can  obtain  a  relative  ranking  of 
manufacturing  alternatives 
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Preference  Analysis 


80% 

70% 


60% 


20% 


CVD 


HiPco 


10% 

0% 


_ PJHiPco 


Rank  4 
Rank  3 
Rank  2 
Rank  1 


The  "Environmentalist" 


60% 


50% 


40% 


Arc 


HiPco 


Rank  4 
Rank  3 
Rank  2 
Rank  1 


CVD 


0% 


Laser 


Energy  consumption  — H 


Health  risks 
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Risk  Assessment:  Framing  the  Problem 


5  risk  categories 
5  nanomaterials 

1.  C6o 

2.  MWCNT 

3.  CdSe 

4.  AgNP 

5.  A1NP 


Very 

high 

risk 


Very 


Low  risk  low  risk 


Medium 

risk 


After  Tervonen  et  al.,  2009 


Category  1 


Category  2 


Category  k 
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Criteria  Measurements 


Agglomeration 

Reactivity 

/charge 

Crit. 

Function 

groups 

Contaminant 

Dissociation 

Bioavailability 
pot.  (±10) 

Bioaccumulation 
pot.  (±10) 

Toxic 

pot. 

(±10) 

Size 

(±10%) 

C60 

4 

2,3 

3 

2 

25 

50 

10 

100 

MWCNT 

4 

2,3 

4 

3 

25 

50 

25 

50 

CdSe 

4 

4.  5 

1 

4 

50 

75 

75 

20 

Ag  NP 

3 

4.  5 

1 

4 

50 

75 

75 

50 

A1NP 

5 

1,2 

1 

1 

25 

75 

10 

50 

Risk  Profiles 


Profile 

Agglomeration 

Reactivity 

/charge 

Crit.  Function 
groups 

Contaminant 

Dissociation 

Bioavailab 

ility 

potential 

Bioaccumul 
ation  pot. 

Toxic  pot. 

Size 

Extreme- 

high 

4 

4 

4 

4 

100 

100 

100 

5 

High- 

medium 

3 

3 

3 

3 

80 

80 

80 

50 

Medium- 

low 

2 

2 

2 

2 

70 

70 

70 

100 

Low-very 

low 

i 

1 

i 

i 

60 

60 

60 

200 

After  Tervonen  et  a$  2^$ 


Direction  of  preference  (lower  risk) 


After  Tervonen  et  al.,  2009 


#  29 


Risk  Assessment:  Results 


Extreme  risk  High  risk  Medium  risk  Low  risk  Very  low  risk 


C60 


MWCNT 


CdSe 


Ag  NP 


Al  NP 


0 

0 

51 

49 

0 

0 

26 

73 

1 

0 

0 

98 

1 

1 

0 

0 

29 

71 

1 

0 

0 

0 

33 

34 

34 

High 

risk 


oW 


ce 


Very 

Low  risk  low  risk 


Medium 

risk 


Very 

high 

risk 


After  Tervonen  et  al.,  2009 
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How  to  Prioritize  Research  in  the  Context 

of  This  Specific  Decision 


■  Research  is  only  useful  if  it  helps  support  and 
influence  future  decisions 

■  Is  more  precise  information  on  health  criteria 
useful?  And  on  manufacturing  criteria? 

■  What  must  be  the  quality  of  information  for  it  to 
be  useful? 

■  Are  the  benefits  of  additional  information  worth 
the  costs? 
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What  is  Value  of  Information  (Vol)  ? 


■  A  measure  of  the  value  that  information  can  bring  in  a  decision 
context 

■  Without  information:  the  outcome  of  decisions  are 
uncertain;  the  optimal  decision  yields  a  prior  expected 
value 

■  With  information,  the  optimal  decision  can  be  made 
depending  on  the  results;  uncertainty  is  reduced;  for  each 
result,  the  optimal  decision  yields  a  posterior  expected 
value;  the  total  posterior  expected  value  is  their  average 

■  Vol:  the  difference  between  posterior  expected  value  and 
prior  expected  value 

■  Computing  Vol  requires  a  decision  model  that  can  make  the 
link  between  information  and  decisions 

■  Information  is  valuable  if  and  only  if  it  might  switch  the 
decision 
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Vol  Results  and  Discussion 


Net  Flow  of 
Best  Alternative 

No  New 

Information 

Manufacturing 

only 

Health 

only 

Full,  Perfect 
Information 

%  of  Vol  from 

M  Only 

%  of  Vol  from 

H  Only 

Manufacturer 

63% 

66% 

63% 

66% 

100% 

0% 

Consumer 

58% 

58% 

62% 

63% 

18% 

84% 

Regulator 

38% 

40% 

56% 

58% 

9% 

90% 

Environmentalist 

16% 

16% 

35% 

35% 

4% 

99% 

Balanced  Weights 

38% 

39% 

39% 

41% 

27% 

48% 

CO 

0) 

-C 

0) 

0.20 

.5? 

> 

ir 

*-p 

o 

4-* 

03 

c 

L. 

0.15 

5 

0) 

4-* 

_o 

LL 

< 

fcuO 

0.10 

4-* 

0) 

c 

z 

'Z 

T3 

o 

o 

0.05 

<D 

CO 

T3 

TJ 

< 

0.00 

Cumulative  Added  Net  Flow  with  New  Info 


■  Manufacturing  only 

■  Health  only 

■  Manufacturing  &  Health 


Manufacturer  Consumer  Regulator  Environmentalist 


0.8 

1 

4-» 

to 

Q) 

0.7 

-C 

ir 

Vfr- 

Q) 

> 

*4-» 

03 

0.6 

0.5 

o 

C 

0.4 

o 

4-» 

LL 

< 

0.3 

4-» 

CUD 

c V 

c 

0.2 

Z 

L 

a» 

o 

&J0 

ru 

VJ 

CO 

0.1 

0) 

0.0 

> 

< 

Stakeholders 


Total  Average  Net  Flow  with  New  Information 

■  Manufacturing  &  Health  ■  Health  only 


■  Manufacturing  only  ■  None 


Manufacturer  Consumer  Regulator  Environmentalist 

Stakeholders 

- T7 - <7^7 


i£=U 


Vol  Results  and  Discussion 
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Total  Average  Net  Flow  with  New  Information 

■  Manufacturing  &  Health  ■  Health  only 


0.7  ■  Manufacturing  only  ■  None 


Manufacturer  Consumer  Regulator  Environmentalist 

Stakeholders 


Manufacturer  &  Consumer  will  be 
confident  with  their  decisions 

Environmentalist  &  Regulator  cannot 
decide  with  confidence 


■  Perhaps  decision  makers  can  make 
concessions  to  wary  stakeholders 

■  Investing  in  health  research  will  have 
the  most  impact 


Cumulative  Added  Net  Flow  with  New  Info 


Manufacturer  Consumer  Regulator  Environmentalist 

Stakeholders 
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Linking  RA,  AM  and  MCDA 


Adaptive 

Management 
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Summary:  Essential  Decision  Ingredients 


?c^Teople: 

Policy  Decision  Maker(s) 


Scientists  and  Engineers 


Stakeholders^^^^  Business.  Interest  groups 


Tools: 


Environmental  Assessment/Modeling  (Risk/Ecological/Environmental  Assessment  and  Simulation  Models) 


Decision  Analysis  (Group  Decision  Making  Techniques/Decision  Methodologies  and  Software) 
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Main  Points 


■  There  are  clear  benefits  to  be  gained  by  advancing  the  use  of 
formal  risk  and  decision  analysis  methods: 

-  Opportunities  to  explore  trade-offs  among  diverse 
objectives 

-  The  ability  to  distinguish  science  and  engineering  inputs  to 
a  decision  from  values  associated  with  objectives 

-  Means  for  exploring  the  implications  of  uncertainty  and 
the  value  of  reducing  it 

-  Providing  a  quantitative  framework  to  implement  adaptive 
management 
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Main  Points 


■  However,  efforts  to  apply  these  approaches  will  confront  a 
number  of  practical  issues  related  to  the  following: 

-  Under-estimating  the  level  of  effort  required  to 
accomplish  effective  deliberation  through  the  use  of 
decision  analysis 

-  Determining  who  can/should  be  involved  in 
value/preference  elicitation 

-  Intolerance  for  transparency  in  decision-making 

-  The  misconception  that  decision  analysis  is  a  substitute  for 
an  actual  decision 
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Conclusions 


■  Decision  models  and  Value  of  Information  analyses  can  prove 
useful  tools  to: 

■  Help  making  decisions  under  uncertainty 

■  Assess  whether  information  gathering  has  value  in  this 
context 

■  To  help  assess  nanomaterials  research  options: 

■  Several  decision  situations  should  be  identified  where 
information  obtained  from  the  research  might  be  useful 

■  A  Vol  analysis  applied  to  these  decision  models  coupled 
with  an  estimation  of  the  costs  of  the  research  and  the 
cost  of  delaying  the  decisions  would  help  assess  whether 
research  proposals  are  worth  the  investment/  which  ones 
are  most  worthy 
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